Double newtonisation of fixed point sequences 

Mario M. Graga * 
February 1, 2008 



Abstract 

A neutral fixed point of a real iteration map u becomes a super 
attracting fixed point using a suitable double newtonisation. The map 
u is so transformed into a map w which is here called the standard 
accelerator of u. The map w provides a unifying process to deal with a 
large set of fixed point sequences which are not convergent or converge 
slowly. Several examples illustrate the main results obtained. 

MSC2000: 65B, 65H05, 65B99. 

Keywords: Fixed point, neutral, iteration function, standard accelerator, 
logarithmic convergence. 

1 Introduction 

The computation of a fixed point x* of a real iteration map u is a difficult 
task when \u'(x*)\ > 1. The case |u'(x*)| = 1 corresponds to a neutral or 
nonhyperbolic fixed point whereas for ^'(x*)! > 1 the fixed point is said to 
be repelling 0] . The aim of this work is to give a simple method to deal 
with these kind of difficulties. 

Let us denote by NEU m , or simply by NEU, the set of real iteration 
maps u, m {m > 1) times continuously differentiable in a neighbourhood of 
a neutral fixed point x* such that u'{x*) = 1. In this work we construct 
simple accelerators for a quite large subset of NEU . Although, as it is well 
known, the set of logarithmically convergent sequences, Log , cannot be 
accelerated J|, || , the same simple accelerators are also useful to apply on a 
large set of logarithmic fixed point sequences, denoted by Log m . 
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In order to show that a certain subset of NEU is accelerable we follow 
the strategy: for a given u £ NEU, (i) obtain an iteration function v 
(depending on u) for which x* is an attracting or repelling fixed point and 
(ii) combine v with u in order to get a final iteration function w for which 
x* is a super attractor. We will call such a w an accelerator of u. Notice 
that the basic assumption is the existence of an isolated fixed point x* for 
u which is (in general) unknown. 

Examples of accelerators constructed using the steps (i) and (ii) above 
are the so-called combined iteration functions which have been introduced 
and studied by the author in ||]. Under mild assumptions on u € NEU 
it is possible to obtain a combined hyperbolic iteration function for instance 
v = C(x,u) and finally an accelerator w = C(x,v). We call w standard 
accelerator. 

In propositions || and [2] simple accelerators are given for particular iter- 
ation maps in NEU. The main results of this paper are propositions 
All results concerning the standard accelerator are new. In lemma |] and 
proposition ^ we characterize the kernel of the standard accelerator giving 
a necessary and sufficient condition for a certain map u in NEU to belong 
to the kernel of w. An iteration map u belongs to the kernel of a map h 
if h{x) = x* for any x. This means that the fixed point x* of u can be 
computed using only one iteration of h. 

In section ^| we apply the results obtained for the standard map to show 
that a certain set of logarithmic fixed point sequences, denoted by FIX, is 
accelerable. 

In section |5] we present several examples illustrating the properties of the 
accelerators studied in previous sections. In examples 1 and 2 simple accel- 
erators are constructed for well known iteration maps namely the function 
u(x) = sin(x) and the logistic map [18, pp. 2]. Examples 3 and 4 deal with 
certain iteration maps which attracted the attention of many researchers 



(see for instance |T5|, 16, with the aim of finding accelerators. We show 
that such maps are accelerable or even belong to the kernel of our standard 
accelerator. Finally, in example 5, the standard accelerator is used for the 
computation of a multiple zero of a complex function. 
This work extends the author's results presented in M. 



2 Definitions 

In this work we will consider two classes of iteration functions defined as 
follows. 
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Definition 1. Assume there exists an isolated fixed point x* of a given iter- 
ation function u, and that u is defined and m-fold continuously differ entiable 
in a neighbourhood T> of x* . Define 

NEU m = {ue C m (D) : u(x*) = x*, u'(x*) = l} , 

and, for j > 1, 

HYPj(u) = {v£ C j (D) : v(x*) = x* , \v'(x*)\ ^ l} . 

The set NEU m is formed by iteration functions with a neutral fixed 
point x* while HYPj (u) is the set of all iteration functions v possessing the 
same fixed point than u for which x* is hyperbolic (attracting or repelling). 
When the degree of smoothness, m or j, is implicit or not relevant these sets 
will be denoted respectively by NEU and HYP. 

Note that the definition of NEU does not include iteration functions such 
that u'{x*) = —1. However this is not restrictive since for u(x) = u(u(x)) 
we get u'(x*) = 1, so u G NEU. 

For a given u G NEU we are interested first of all in obtaining v in 
HYP {v depending on u) such that v'{x*) ^ 1, that is x* is a hyperbolic 
fixed point for v. Whenever we can explicitly construct an iteration function 
h, having the same fixed point as u such that h'(x*) = this will be called 
an accelerator of u. When we are able to construct an iteration map h which 
accelerates any iteration function u in a certain subset of NEU we say that 
such a set is accelerable and that h is an accelerator of this set. 

Whenever an iteration function h accelerates u G NEU and there ex- 
ists an integer k such that h'(x*) = h^(x*) = ... = h^ k \x*) = and 
we say that h is a k-accelerator of u. Also, when the deriva- 
tives of any order of h are zero at x* , the iteration function h will be called 
an oo -accelerator. 

3 Simple accelerators 

For a conveniently chosen xq G T>, a function u in NEU gives rise to a 
sequence x n+ \ = u(x n ). If (x n ) — >x* , this sequence is known to be of 

n 

logarithmic convergence since it satisfies lim n _ +00 (x n _(_i — x *)/{x n -x*) = 1 
(see @, pp. 2]). 

The next proposition shows that logarithmic fixed point sequences hav- 
ing zero as fixed point are easily accelerable. 
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Proposition 1. For any g G NEU m such that x* = the following itera- 
tion function hj , 

h i( x ) = Jo 9(t)dt 

(1) 

h ii x ) = Jo h i-i( t ) dt > 3 = ,m 
is at least a (j — 1) -accelerator of g. 

Proof As g G NEU m then g(0) = and g'(0) = 1/0. Also for any j 
one has hj(0) = 0. By the fundamental theorem o Calculus h'-y{x) = g{x) 
and so h\ is at least an 1-accelerator. Since hf{x) = g'{x) and hf\o) = 
hf~ (0) = for all j < j, the result follows. □ 

In example 1 of section [5] this result is applied to g(x) = sin(x) G NEU^o 
where an accelerator of arbitrary order is obtained for g. 

Another simple way to improve the order of acceleration of an iteration 
function is by composition with itself: 

Proposition 2. If h is an accelerator of NEU m then the iteration function 

hk = ho ho ...oh (2) 

k times 

is at least a k-accelerator of NEU m for k < m. 

Proof. As h G NEU m is an accelerator then h(x*) = x* and h'{x*) = 0. 
By the chain rule h' 2 (x) = h'(h(x)) h'{x) and h^ ] ' (x) = h^ 2 \h(x)) h'(x) 2 + 
h'{h{x)) h^ 2 \x). Hence h' 2 (x*) = h < 2 \x*) = 0, that is h 2 is at least a 2- 
accelerator and the result follows by mathematical induction in A:. □ 

In H [| we introduced and studied other type of accelerators namely 
those resulting of a suitable combination of u G NEU with an iteration 
function v G HYP. We called these iteration functions combined. 

Definition 2. Let u be a function with a fixed point x* and v G HYP. The 
following iteration function h = C(u,v), 

h(x) = C(u, v){x) = — (3) 

1 — v (x) 

is called a combined iteration function. 
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Note that by the given definition of combined iteration function it results 
that u and v possess the same (generally unknown) fixed point x*. Further- 
more, as a consequence of the definition of h = C(u,v) we have h'(x*) = 
when u € NEU. So the next proposition. 

Proposition 3. Let u E NEU m and v G HYPj with m > 1 and j > 2. 
Then, the combined function h = C(u,v) is an accelerator of u. 

Let us remark that for iteration functions verifying 7^ 1, that is 

for v G HYP, a simple accelerator is h(x) = C(x,v). Thus h accelerates 
HYP, either the sequence x n+ \ = v(x n ), for xq sufficiently close to x* , is 
convergent to x* or not. 

Neutral iteration functions satisfying the following hypotheses (Hi) often 
arise in the applications: 

(u(x*) = x*, 
fiV) = 1, (4) 
u( 2 )(x*) =a^0, aeR. 

Define NEU2 as the set of iteration functions in NEU m for which (Hi) 
holds. For u G NEU2 consider the iteration function 

4>(x) = u(x) — u (x) + 1. (5) 



Proposition 4. The set NEU2 is accelerable. An accelerator is the itera- 
tion function h = C(x, 4>): 



h(x) 



4>(x) — xcj>'(x) 
1 - ft(x) ' 



where (j) is defined as in (||). 



Proof. Let u £ NEU2- Since <fi(x*) = x* and 4>'(x*) 
(j) E HYPj (j > 2) and proposition ^ holds. 



(6) 



1 - a / 1, hence 
□ 



We remark that when u £ NEU m the combined function C(x,u) is not 
defined at x*. However under the hypotheses 



(H) 



u(x*) = 
u'(x*) = 
u^(x*) = 
u^ m \x*) 



X, 

1, 

0, 2 < j < m - 1, 



(7) 
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(which are stronger than (Hi)) we can continuously extend C(x,u) in order 
to get v G HYP. Namely, for u G NEU m , 

u(x)—xu'(x) # 
= < 1 - it' (a;) (8) 



is in HYP since < v'(x*) = 1 — 1/m < 1 (see for instance [11, pp. 99]). 
So, by proposition [3| we obtain the following result. 

Proposition 5. Let u G NEU m and v as in @. If u satisfies (H) then the 
iteration function 

w{x) = C(x, v)(x) = - _ (9) 

is an accelerator of u. 

The map w given in proposition ||| is a powerful accelerator. Hereafter 
whenever we use the symbol w we are referring the map w given in propo- 
sition |5| and we will call it the standard accelerator of u. The iteration func- 
tion v given by (§) is Newton's iteration function N(x) = x — ■0(x)/^'(x) 
for ip(x) = x — u(x) and w is the Newton's iteration function for ip(x) = 



(x — u)/(l — u'(x)) (see for instance [19, pp. 127]). Hence the final map w is 



directly obtained as a double newtonisation. Of course any other iteration 
function v G HYP can be combined with u G NEU in order to obtain an 
accelerator. The iteration function v given in (||) is a good choice but many 
other possibilities are available. For instance the well known Steffensen's 
iteration function v(x) = x — (u(x) — x) 2 /(x — 2u(x) + u(u(x))) ([||, pp. 
315]), which is a reformulation of the Aitken's A 2 process [ffl], can be used 
or any other iteration function known to transform a neutral fixed point x* 
of u into an attracting one. 

Between the possible accelerators for a given map the best one one can 
get is an accelerator that transforms any initial point into the fixed point. 
This corresponds to the notion of the kernel of an accelerator. 

Definition 3. For u, v and w as in proposition the set 

ker w = {u G NEU m : w(x) = x*} 
is called the kernel of w. 
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In examples 3 and 4 of section |5| we show that several iteration functions 
generating logarithmic fixed point sequences belong to the kernel of the 
standard accelerator w. 

A characterization of the kernel of the standard accelerator in terms of 
the initial iteration map u is given by proposition |6[ Let us first prove a 
lemma characterizing the kernel of w in terms of the auxiliary function v. 

Lemma 1. Let v as in (||) and w as m (|). An iteration function u € NEU 
belongs to the kernel of w if and only if v is the linear function 

v{x) = (l-v'(x*))x* + v'{x*)x, (10) 

for x belonging to a neighbourhood of the (isolated) fixed point x* . 

Proof. By definition u £ Ker w if and only if w is the constant function 
w(x) = x*, for all x. So, w'(x) = Vx. Differentiating w(x) given by (g) we 
have, 

w'(x) = v"(x) (v(x) — x) = 

<^=> v"(x) = or v(x) = x. 

As by hypothesis v'(x*) ^ 1 then the case v(x) = x is excluded. So, w'(x) = 
iff v"(x) = 0. That is, v(x) is of the form v(x) = ax + b. As v(x*) = x* 
and v'(x*) exists then a = v'(x*) and b = (1 — v'(x*))x* . □ 



Proposition 6. An iteration function u € NEU m satisfying (H) belongs 
to the kernel of the standard map w if and only if u has the form 

u(x) = x + a (x* - x) 13 , (11) 

for some constants a and (3 with (3^0. 

Proof. Let u G NEU m . By lemma |l] there are constants a ^ 1 and b = 
(1 — a) x* such that 



v(x)=ax + b (12) 



where 



= u(x) - x u'(x) e jjyp (13) 
1 — n'(x) 

Equating (||) and (||) we have that u belongs to the kernel of w if and only 
if it is a solution of the following first order differential equation 

(b+ (a- l)x)u'(x) +u(x) = ax + b. (14) 
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The general solution of (14) is 

u(x) = x + c ( 



(1 — a)x) 1 ~ a , Vc G 



(15) 



The solution it given by ([lq ) satisfies u{x ) = x* and it (x*) = 1 for an 

i 

arbitrary constant c since 6 = (1 — a) a;*. So, taking a = c(l — a) 1 -" and 
/3 = 1/(1 — a) the result follows. □ 



4 The standard accelerator and logarithmic fixed 
point sequences 

As remarked by Delahaye in j|, pp. 181], "logarithmically convergent se- 
quences are difficult to accelerate: it is not possible to accelerate all of them 
with only one transformation" (that is Log is not accelerable) . However the 
scenario is quite different for fixed point sequences. 

Let us define hypj as being the set of sequences generated by iteration 
functions in HYPj and Log m C Log defined as follows: 

Log m = {(x n ) : x n+ \ = u(x n ), xq G T>, u G NEU m and it satisfies (H)} . 

(16) 

We show in the next proposition that the set FIX = hypj U Log m , 
of fixed point sequences can be accelerated using a single transformation 
namely the one associated to our standard map w. 

We say that a sequence to sequence transformation W : (x n ) — ► (w n ) 
accelerates the convergence of (x n ) if (w n ) — >x* and lim n ^ QO (w n —x*) / (x n — 
x*) = 0. 

Let (x n ) G FIX and W : (x n ) — > (w n ) be the sequence to sequence 
transformation such that w n = {w(x n —\)), n = 1,2,... where v and w are 
iteration functions as in proposition [|. 

Proposition 7. For any natural numbers m and j, and for xq chosen suf- 
ficiently close to x* , the set FIX is accelerable by the sequence to sequence 
transformation W . 

Proof. If (x n ) G FIX then either (x n ) G hypj or (x n ) G Log m (note that 
these two sets do not intersect). By definition of FIX the sequence (x n ) is 
generated by an iteration function it i.e. x n = u{x n -\). If it G HYPj then 
both v = C(x, it) and w = C(x, v) verify v'(x*) = = w'(x*) since they are 
combined iteration functions. 
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If (x n ) G Log m and (H) holds then proposition [| yields also w'(x*) = 0. 
So, either for (x n ) in Log m or Ziypj, the chain rule and the mean value theo- 
rem applied to the function F = w o v o u enable us to claim that there 
exists a neighbourhood £2 of x* such that for any xq € ft the sequence (w n ) 
converges to x* and lim n ^ 00 (tt> n — x*)/(x n — x*) = 0. That is W accelerates 
FIX. □ 

5 Examples 

Example 1. The iteration function g{x) = sinx is frequently used as a test 
function for assessing the quality of sequence to sequence transformations ||, 
pp. 325]. Popular sequence transformations such as the e and p algorithms 
(see respectively |2iJ and p2fl ) , Richardson extrapolation |?], pp. 181] , iter- 
ated Aitken A 2 (|f,||, pp. 229] and for instance^), Overholt process 
and Levin transformation [jl3| are unable to accelerate g. The algorithm 
H produces satisfactory numerical results though it is only a 1-accelerator 
for the sequence x n+ \ = g(x n ). 

We show below that there are j-accelerators for g of the type given in 
(Q). Our standard map w is also compared with Aitken's A 2 process and the 
02 procedure. As can be seen in table |l| the map w performs much better 
than the referred processes. 

a) The map g(x) = sinx has j -accelerators, with j > 1, of the type (Q). 
Indeed 

g(x) = sinx € NEUoo, g(0) = 

so by proposition [l] the function g is oo-accelerable. The first hj— 
accelerators of g are 

h\ (x) = sin t dt = 1 — cos x 
h2(x) = Jq hi(t) dt = x — sinx 
hz(x) = Jq h\(t) dt = =y — 1 + cosx. 
It is easily deduced an explicit formula for hj, ( j > 1) : 

' j— 1 3+1 

(— 1)~ qj-i(x) + (— l)~a~ cos x, for j odd 

hj(x) = < 



j—2 j 

(— 1) 2 pj_i(x) + (—I) 5 sinx, for j even. 



9 



where qj(x) and Pj(x) are the Maclaurin polynomial of degree j, re- 
spectively of cos x and sin x. The iteration function hj is a j-accelerator 
of g. 

b) For g{x) = sin(x) the maps v = C(x,g) and w = C(x,v) are respec- 
tively, 

. , x cos(x) — sin(x) 



(x — 1) sm(x) + cos(x) (x + sm i — x 

w(x) = — — . 

2 cos(x) + x sin(x) — 2 

In table |l] is displayed the first 4 iterations for the maps g, v and w 
with starting point xq = 3.0. These results are compared with the 
Aitken's A 2 process and the 02 procedure. 



Table 1: Iterations for the maps g, v, w with starting point xq = 3.0. 
Comparison with A 2 and G2 processes. 
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V 


w 


A 2 


e 2 


3.0 


3.0 


3.0 






0.14112 


1.56337 


1.40041 


0.140652 




0.140652 


0.995758 


0.173163 


0.0938926 


0.141125 


0.140189 


0.652467 


0.000345858 


0.0935825 


-0.000754788 


0.13973 


0.431844 


7.30548 x 10~ 13 







Example 2. The well known logistic map pp. 2] 

u(x) = a x (1 — x) 

has the neutral fixed point x* = when a = 1. Since u'(0) = 1 and 
u( 2 )(0) = -2^0 then u G NEU 2 - So, by proposition f§ for 

4>{x) = u(x) — u(x) + 1 = 3 — x 2 , 

the iteration map 

h(x) = C(x, 4>){x) = X x^l, 
2{x — 1) 
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is an accelerator for u. The table [2] displays some iterations respectively for 
Vn = u(y n -i) and x n = h{x n -i) taking yo = = 0-5 as starting point. 

When a ^ 0,1, the fixed point is x* = and u € HYP since 

a 

u'(x*) = 2 — a ^ 1. So, by proposition |3] the iteration map h = C(x,u) is 
an accelerator for u: 

, . . u(x) — xu'(x) ax 2 , a — 1 

1 — u(x) 1 — a + 2ax 2a 



Table 2: y n = u(y n -i), x n = /i(x n _i) 



Vn 


•En 


0.5 


0.5 


0.25 


-0.25 


0.1875 


-0.025 


0.1523... 


-0.000304 . . . 



Example 3. The following iteration function g (cf. [||) belongs to the kernel 
of the standard map w: 

g(x)=x + (x-lf /2 , x* = l. 

Note that g G NEUi and g'(l) = 1. We have, 

l-g'{x) 3 

and w(x) = C(x,v)(x) = 1 = x*. In fact as the iteration function v has the 
form 

v(x) = (1 - v'(x*))x* + u'(a?*) x, 

then, by lemma 111, g belongs to the kernel of w. 

Proposition g can be directly applied to the computation of the multiple 
zero of a polynomial of the type 

p(x) = a(x- C) r , 

where a/0 and r > 1. Indeed p has a zero £ of multiplicity r and 

= x — p{x) = x — a{x — CY 



11 



has the form (11) of proposition ||, that is u belongs to Ker w . 
More generally, for a ^ and reK, r > 1 consider the set 

V = {g€ NEUoo : g(x) = x + a(x - x*) r } . 

Computing v = C(x,g), for g £ V, one has 

v(x) = (1 — —)x + -x*. 

Thus v has the form ( |io|) of lemma [l] and so any iteration function in V 
belongs to Ker w . 

Example 4- In |l^, [U], 17] several sequence to sequence transformations 
have been developed and tested in order to find an accelerator for logarith- 
mic sequences generated by iteration functions belonging to subsets of the 
following set 

S = { g G NEUoo : g(x) = x + ^Zl a i( x ~ x *Y +% } . 

where Qi / 0, r £ 1, r > 1. 

The referred authors hardly found an accelerator for some subsets of S 
in spite of considering only positive integers r and a% < 0. 

The set S is accelerable by our standard map w. Indeed, since 

g'(x) = 1 + ai(r + l)(x - x*) r + q r (x), 

where q r {x) is a power series of (x — x*) whose first term has degree r + 1 we 
get g G NEUoo, g {j) (x*) = 0, 2 < j < r and s> (r) (x*) + 0. So proposition 
H holds. 

Example 5. 

Although the combined iteration functions have been defined for real 
functions they can be generalized to complex maps. The extension of the 
results obtained in this paper to higher dimensional maps will be object of 
another work. 

In order to illustrate the behaviour of the standard (complex) accelerator 
we chose the analytic function 

f(z) = z 2 (z- 2) 2 (e 2z cos z + z 3 - 1 - sin z) (17) 



studied by Kravanja and Van Barel [12, Example 4]. These authors have 
used this function to test their algorithms for the simultaneous computation 
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of zeros of analytic functions. As stressed in the referred work the accuracy 
of the numerical results obtained by such algorithms diminishes as the mul- 
tiplicity of a zero increases. The best numerical results obtained in [^] for 
the multiple roots £i = and Q2 = 2 (both having only multiplicity 2) do 
not exceed 7 correct digits. 

Our combined maps do not need the knowledge of the multiplicity of a 
zero and produce accurate numerical results in a few iterations as shown in 
table ^ where, for instance, the multiple zero £2 is accurately computed in 5 
iterations of the standard map. However, the price to pay with our methods 
is the need for an initial approximation for each zero (chosen, say, to be 
within an euclidean distance about 0.1 from a zero of /). 

The basic iteration function to be used is u(z) = z — f(z), which can 
lead to complex divergent sequences y n = u(y n -i), with yo £ C taken as 
initial approximation to a zero of / (see table ||). The sequence obtained by 
iteration of the standard complex map is denoted by (z n ) with zq = y^. The 
numerical example presented here has been programmed in Mathematica 
[p3| and the computations were carried out with 16 digits of precision. Due 
the lack of space in table |3] the imaginary part of each iterate has been 
partially truncated. 

Table 3: First 6 iterations for u(z) and w(z), with zq = 1.9 + 0.1 i. 



Vn = u{y n -i) 


z n = w(z n -i) 


1.900000000000000 +0.10000000 i 
2.391422135261736 - 0.4699667 i 
-190.6272479365824 + 83.78040 i 
-1.078985533 x 10 45 + 2.057 x 10 45 i 
" Indeterminate" 
" Indeterminate" 


1.900000000000000 + 0.1000000 i 
2.033556020548597 + 0.0804529 i 
2.010056510555553 - 0.01717596 i 
2.000502552323976 + 0.0010266 i 
2.000002378186929 - 3.083 x 10" 6 i 
1.999999999946048 + 0. x 10~ 16 i 
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